Improving automatic image annotation: Approach by Bag-Of- Key Point
نویسندگان
چکیده
Automatic image annotation is to associate each image a set of keywords and describing the visual content of the image using an automatic system without any human intervention, many approaches have been proposed for the realization of such a system However, it is still inefficient in terms of semantic description of the image. Recent works show a frequent use of a special technique known as bag-of-key points that describes an image as a set of local descriptors using a histogram. Each bin of the histogram represents the importance of a visual pattern (called visual word) in the image. But crucial representation choices such as the choice of local features, the steps of building the visual vocabulary have not been thoroughly studied in existing works. In this paper, a novel approach based on Scale Invariant Features Transform (SIFT) features and treatment of the different steps of building de vocabulary are proposed. The proposed approach creates more robust signatures for images and better reflects the weight of visual words. The categorization of images has been the subject of the second phase of this approach. The purpose of this phase was to find a classification model that best suits the index method proposed, while avoiding problems due to large data and large dimension. Experiments with Corel-1000 dataset demonstrate that the proposed improvements outperform known techniques in scene categorization.
منابع مشابه
Tags Re-ranking Using Multi-level Features in Automatic Image Annotation
Automatic image annotation is a process in which computer systems automatically assign the textual tags related with visual content to a query image. In most cases, inappropriate tags generated by the users as well as the images without any tags among the challenges available in this field have a negative effect on the query's result. In this paper, a new method is presented for automatic image...
متن کاملFuzzy Neighbor Voting for Automatic Image Annotation
With quick development of digital images and the availability of imaging tools, massive amounts of images are created. Therefore, efficient management and suitable retrieval, especially by computers, is one of themost challenging fields in image processing. Automatic image annotation (AIA) or refers to attaching words, keywords or comments to an image or to a selected part of it. In this paper,...
متن کاملScalable Image Annotation by Summarizing Training Samples into Labeled Prototypes
By increasing the number of images, it is essential to provide fast search methods and intelligent filtering of images. To handle images in large datasets, some relevant tags are assigned to each image to for describing its content. Automatic Image Annotation (AIA) aims to automatically assign a group of keywords to an image based on visual content of the image. AIA frameworks have two main sta...
متن کاملUsing a bag of Words for Automatic Medical Image Annotation with a Latent Semantic
We present in this paper a new approach for the automatic annotation of medical images, using the approach of "bag-of-words" to represent the visual content of the medical image combined with text descriptors based approach tf.idf and reduced by latent semantic to extract the co-occurrence between terms and visual terms. A medical report is composed of a text describing a medical image. First, ...
متن کاملFusing semantic aspects for image annotation and retrieval
In this paper, we present an approach based on probabilistic latent semantic analysis (PLSA) to achieve the task of automatic image annotation and retrieval. In order to model training data precisely, each image is represented as a bag of visual words. Then a probabilistic framework is designed to capture semantic aspects from visual and textual modalities, respectively. Furthermore, an adaptiv...
متن کامل